BattleView: A Multimodal HCI Research Application

To demonstrate some of our research topics in Human Computer Interaction (HCI), we employ two modes of natural human-computer interaction to control a virtual environment. By using speech and gesture recognition, we outline the control of a virtual environment research testbed (BattleView) without the need for traditional virtual reality interfaces such a wand, mouse, or keyboard. The use of features from both speech and gesture creates a unique interface where different modalities complement each other in a more “human” communication style.